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Abstract: The trace approximation problem for Toeplitz matrices and 
its applications to stationary processes dates back to the classic book by 

\*J Grcnander and Szego, Toeplitz forms and their applications. It has then 

^_^ t been extensively studied in the literature. 

[****" , In this paper we provide a survey and unified treatment of the trace 

\^2 i approximation problem both for Toeplitz matrices and for operators and 

describe applications to discrete- and continuous-time stationary processes. 
The trace approximation problem serves indeed as a tool to study many 
probabilistic and statistical topics for stationary models. These include cen- 
tral and non-central limit theorems and large deviations of Toeplitz type 
random quadratic functionals, parametric and nonparametric estimation, 
prediction of the future value based on the observed past of the process, 
etc. 

K^ ' We review and summarize the known results concerning the trace ap- 

» I _ proximation problem, prove some new results, and provide a number of 

J^ , applications to discrete- and continuous-time stationary time series mod- 

els with various types of memory structures, such as long memory, anti- 
persistent and short memory. 
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1. Introduction 

Toeplitz matrices and operators, which have great independent interest and a 
wide range of applications in different fields of science (economics, engineering, 
finance, hydrology, physics, signal processing, etc.), arise naturally in the context 
of stationary processes. This is because the covariance matrix (resp. operator) of 
a discrete-time (resp. continuous-time) stationary process is a truncated Toeplitz 
matrix (resp. operator) generated by the spectral density of that process, and 
vice versa, any non-negative summablc function generates a Toeplitz matrix 
(resp. operator) , which can be considered as a spectral density of some discrete- 
time (resp. continuous-time) stationary process, and therefore the corresponding 
truncated Toeplitz matrix (resp. operator) will be the covariance matrix (resp. 
operator) of that process. 

Truncated Toeplitz matrices and operators are of particular importance, and 
serve as tools, to study many topics in the spectral and statistical analysis of 
discrete- and continuous-time stationary processes, such as central and non- 
central limit theorems and large deviations of Toeplitz type random quadratic 
forms and functionals, estimation of the spectral parameters and functionals, 
asymptotic expansions of the estimators, hypotheses testing about the spectrum, 
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prediction of the future value based on the observed past of the process, etc. 
(see, e.g., [1] - [7], [9, 11, 12, 14, 15], [17] - [66], and references therein). 

The present paper is devoted to the problem of approximation of the traces 
of products of truncated Toeplitz matrices and operators generated by inte- 
grable real symmetric functions defined on the unit circle (resp. on the real 
line). We discuss estimation of the corresponding errors, and describe applica- 
tions to discrete- and continuous-time stationary time series models with various 
types of memory structures (long- memory, anti-persistent and short-memory) . 

The paper contains a number of new theorems both for Toeplitz matrices and 
operators, which are stated in Sections 2 and 3, respectively. Those in Section 
3 involving Toeplitz operators are proved in Section 5. The corresponding the- 
orems of Section 2 involving Toeplitz matrices can be proved in a similar way 
and hence are omitted. Section 4 concerns applications and also contains some 
new results. These are proved within the section. 

The paper is organized as follows. In the remainder of this section we state 
the trace approximation problem and describe the statistical model. In Section 
2 we discuss the trace problem for Toeplitz matrices. Section 3 considers the 
same problem for Toeplitz operators. Section 4 is devoted to some applications 
of the trace problem to discrete- and continuous-time stationary processes. In 
Section 5 we outline the proofs of Theorems 3.1 - 3.4. An appendix contains the 
proofs of technical lemmas. 

1.1. The Trace Approximation Problem 



The problem of approximating traces of products of truncated Toeplitz matrices 
and operators can be stated as follows. 

Let T-L = {hi, /12, ■ • ■ , h m } be a collection of intcgrable real symmetric func- 
tions defined on the domain A, where A = R := (— oo, oo) or A = T := (— ir.ir], 
and let Ar(hk) denote either the T-truncated Toeplitz operator, or the T x T 
Toeplitz matrix generated by function hk (the corresponding definitions are 
given below). Further, let 



t := {r k : r k € {— 1, 1}, k = 1, m} 
be a given sequence of ±l's. Define 



Sa,-h,t( T ) '■= f tr 



UiMhkY 



,fe=i 



where tr[A] stands for the trace of A, 

M^u.t ■= (27T)™- 1 J ]\{h k {X)Y*d\, 
and 



fc=l 



&a,k,hA t ) := \S AM AT) - M A , KjT | 



(1.1) 
(1.2) 

(1.3) 
(1.4) 
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The problem is to approximate Sa,h,t(T) by Ma,h,t an d estimate the error 
rate for &a,a,h,t(T) as T — > oo. More precisely, for a given sequence r = {r^ € 
{ — 1, 1}, fc = l,m} find conditions on functions {/ifc(A), fc = 1,™} such that: 

Problem (A) : 1\ a .a,hA t ) = o(l) as T ^ oo, or 
Problem (B) : A^ iAjWiT (T) = 0{T~~<), 7 > 0, as T -► 00. 

The trace approximation problem goes back to the classical monograph by 
Grenander and Szego [37], and has been extensively studied in the literature 
(see, e.g., Kac [46], Rosenblatt [54], [55], Ibragimov [42], Taniguchi [58], Avram 
[4], Fox and Taqqu [17], Taqqu [62], Dahlhaus [15], Giraitis and Surgailis [34], 
Ginovyan [21], Taniguchi and Kakizawa [60], Lieberman and Phillips [48], Gi- 
raitis et al. [33], Ginovyan and Sahakyan [29]- [32], and references therein). 

In this paper we review and summarize the known results concerning Prob- 
lems (A) and (B), prove some new results, as well as provide a number of appli- 
cations to discrete- and continuous-time stationary time series models that have 
various types of memory structures (short-, intermediate-, and long- memory). 

We focus on the following special case which is important from an application 
viewpoint, and is commonly discussed in the literature: m = 2u, Tfc = 1, k = 1, m 
(or Tfc = (— l) k , k = l,m), and 

ft! (A) = h 3 (X) = ■■■ = h 2v -i{X) := f(X) (1.5) 

h 2 (\) = h 4 (\) = ■ ■ ■ = h 2v (\) := g(\). 

Throughout the paper the letters C and c, with or without index, arc used 
to denote positive constants, the values of which can vary from line to line. 
Also, all functions defined on T are assumed to be 27r-periodic and periodically 
extended to K. 



1.2. The Model: Short, Intermediate and Long Memory Processes. 

Let {X(u), u £ U} be a centered, real- valued, continuous-time or discrete- 
time second-order stationary process with covariance function r(u), possessing 
a spectral density function /(A), A e A, that is, 

E[X(u)}=0, r(u) =E[X(t + u)X(t)}, u,teU, 

and r(u) and /(A) arc connected by the Fourier integral: 

r{u) = I cxp{iAu}/(A)dA, ueV. (1.6) 

Ja 

Thus, the covariance function r(u) and the spectral density function /(A) are 

equivalent specifications of second order properties for a stationary process 

A(«). 

The time domain U is the real line R in the continuous-time case, and the set 

of integers Z in the discrete-time case. The frequency domain A is M. in the 
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continuous-time case, and A = T = (— tt,tt] in the discrete-time case. In the 
continuous-time case the process X(u) is also assumed measurable and mean- 
square continuous: ELY (t) — X(s)] 2 — > as t — > s. 

The statistical and spectral analysis of stationary processes requires two types 
of conditions on the spectral density /(A). The first type controls the singulari- 
ties of /(A), and involves the dependence (or memory) structure of the process, 
while the second type - controls the smoothness of /(A). 

Dependence (memory) structure of the model. We will distinguish the 
following types of stationary models: 

(a) short memory (or short-range dependent), 

(b) long memory (or long-range dependent), 

(c) intermediate memory (or anti-persistent). 

The memory structure of a stationary process is essentially a measure of the 
dependence between all the variables in the process, considering the effect of all 
correlations simultaneously. Traditionally memory structure has been defined in 
the time domain in terms of decay rates of long-lag autocorrelations, or in the 
frequency domain in terms of rates of explosion of low frequency spectra (see, 
e.g., Beran [7], Gucgan [38], Robinson [52], and references therein). 

It is convenient to characterize the memory structure in terms of the spectral 
density function. 

Short-memory models. Much of statistical inference is concerned with 
short-memory stationary models, where the spectral density /(A) of the model 
is bounded away from zero and infinity, that is, there are constants C\ and C% 
such that 

< Ci < /(A) < C 2 < oo. 

A typical short memory model example is the stationary Autoregressive 
Moving Average (ARMA)(p,q) process whose covariance r(u) is exponentially 
bounded: 

\r(k)\ < Cr~ k , fc = l,2,...; < C < oo; < r < 1, 

and the spectral density is a rational function. 

Discrete-time long- memory and anti-persistent models. Data in many 
fields of science (economics, finance, hydrology, etc.), however, is well modeled 
by a stationary process with unbounded or vanishing spectral density (see, e.g., 
Beran [7], Gucgan [38], Palma [50], Taqqu [61] and references therein). 

A long-memory model is defined to be a stationary process with unbounded 
spectral density, and an anti-persistent model - a stationary process with van- 
ishing spectral density. 

In the discrete context, a basic long-memory model is the Autoregressive 
Fractionally Integrated Moving Average (ARFIMA)(0,d, 0)) process X(t) de- 
fined by 

(l-B) d X(t)=e(t), 0<d<l/2, 
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where B is the backshift operator BX(t) = X(t — 1) and e(t) is a discrete-time 
white noise. The spectral density of X(t) is given by 

/(A) = |l-e lA |- 2d = (2sin(A/2))- 2d , < A < w, < d < 1/2. (1.7) 

A typical example of an anti-persistent model is the ARFIMA(0,d, 0) process 
X(t) with spectral density /(A) = |1 - e lX \- 2d with d < 0. 

Note that the condition d < 1/2 ensures that J_ f(X)dX < oo, implying that 
the process X(t) is well defined because -E[|X(£)| 2 ] = J_ f(X)d\. 

Data can also occur in the form of a realization of a "mixed" short- long- 
intermediate- memory stationary process X(t) with spectral density 

f(X) = f I (X)f L (X)f s (X) 7 

where //(A), /l(A) and /s(A) are the intermediate, long- and short-memory 
components, respectively. A well-known example of such process, which appears 
in many applied problems, is an ARFIMA(p, d, q) process with spectral density 

f(\) = \l-e iX \- 2d h(X), d<l/2, (1.8) 

where h(X) is the spectral density of an ARMA(p, q) process. Observe that 
for < d < 1/2 the model X(i) specified by (1.8) displays long-memory, for 
d < - intermediate-memory, and for d = - short-memory. For d > 1/2 the 
function /(A) is not integrable, and thus it cannot represent a spectral density 
of a stationary process. Also, if d < — 1, then the series X(t) is not invertiblc 
in a sense that it cannot be used to recover a white noise e(t) by passing X(t) 
through a linear filter (see [9, 11]). 

The ARFIMA(p, d, q) processes, first introduced by Granger and Joyeux [36], 
and Hosking [41], became very popular due to their ability in providing a good 
characterization of the long-run properties of many economic and financial time 
series. They are also very useful for modeling multivariate time series, since they 
are able to capture a larger number of long term equilibrium relations among 
economic variables than the traditional multivariate ARIMA models (see, e.g., 
Henry and Zaffaroni [40] for a survey on this topic). 

Another important long- memory model is the fractional Gaussian noise (fGn) . 
To define fGn first consider the fractional Brownian motion (fBm) {B(t) := 
B Hit) it <G R} with Hurst index H, < H < 1, defined to be a centered Gaus- 
sian i7-self-similar process having stationary increments, that is, Bnit) satisfies 
the following conditions: 

(a) E[B(t)] = 0; 

(b) B(at) = a H Bit) for any a > and t € K; 

(c) B(t + u)- B(u) = B(t) - B(0) for any t,ueR; 

(d) the covariance function is given by 

Cov(B(s),B(t)) = f[\t\ 2H -\s\ 2H -\t-sr}, 
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where a 2 , = VarB(l), and where the symbol = stands for equality of the finite- 
dimensional distributions. Then the increment process 

{X(k) := B H (k + 1) - B H (k),k g Z}, 

called fractional Gaussian noise (fGn), is a discrete-time centered Gaussian 
stationary process with covariancc function 

r(t)) = f [\k + l\ 2H -\k\ 2H -\k-l\ 2H ], fcGZ (1.9) 

and spectral density function 

oo 

/(A)=c|l-e lA | 2 J2 \\ + 2irk\- ( - 2H+1) 7 -it < X < n, (1.10) 

k— — oo 

where c is a positive constant. 

It follows from (1.10) that /(A) ~ clAI 1 - 2 ^ as A -> 0, that is, /(A) blows 
up if H > 1/2 and tends to zero if H < 1/2. Also, comparing (1.7) and (1.10), 
we observe that, up to a constant, the spectral density of fGn has the same 
behavior at the origin as ARFIMA(0, d, 0) with d = H - 1/2. 

Thus, the fGn {X(k),k e Z} has long-memory if 1/2 < H < 1 and is anti- 
percipient if < H < 1/2. The variables X(k)'s are independent if H = 1/2. 
For more details we refer to Samorodnisky and Taqqu [57] and Taqqu [61]. 

Continuous-time long- memory and anti-persistent models. In the 

continuous context, a basic process which has commonly been used to model 
long-range dependence is fractional Brownian motion (fBm) Bh with Hurst 
index H, defined above. It can be regarded as Gaussian process having a spectral 
density: 

f(X)=c\X\- {2H+1 \ c>0, 0<H<1, Ael, (1.11) 

where (1.11) can be understood in a generalized sense since the fBm Bh is a 
nonstationary process (see, e.g., Anh et al. [3] and Gao et al. [20]). 

A proper stationary model in lieu of fBm is the fractional Riesz-Bessel motion 
(fRBm) , introduced in Anh et al. [2] , and defined as a continuous-time Gaussian 
process X{t) with spectral density 

/(A) = c|Ar 2Q (l + A 2 r /3 , Aet, 0<c<oo, 0<a<l, /3>0. (1.12) 

The exponent a determines the long-range dependence, while the exponent /3 
indicates the second-order intermittency of the process (see, e.g., [3, 20]). 

Notice that the process X(t), specified by (1.12), is stationary if < a < 1/2 
and is non-stationary with stationary increments if 1/2 < a < 1. Observe 
also that the spectral density (1.12) behaves as 0(|A| _2a ) as |A| — > and as 
0(|A|- 2(Q+/3) ) as |A| -> oo. Thus, under the conditions < a < 1/2, j3 > and 
a + j3 > 1/2, the function /(A) in (1.12) is well-defined for both |A| -4 and 
|A| — > oo due to the presence of the component (1 + A 2 ) - ^, /3 > 0, which is the 
Fourier transform of the Bessel potential. 

Comparing (1.11) and (1.12), we observe that the spectral density of fBm is 
the limiting case as {3 — > that of fRBm with Hurst index H = a — 1/2. 
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1.3. A Link Between Stationary Processes and the Trace Problem. 

As it was mentioned above, Toeplitz matrices and operators arise naturally in 
the theory of stationary processes, and serve as tools, to study many topics of 
the spectral and statistical analysis of discrete- and continuous-time stationary 
processes. 

To understand the relevance of the trace approximation problem to station- 
ary processes, consider a question concerning the asymptotic distribution (as 
T — > oo) of the following Toeplitz type quadratic functionals of a Gaussian sta- 
tionary process {X(u), u £ U} with spectral density /(A), A <G A and covariance 
function r(t) := fit), t £ U (here U and A are as in Section 1.2): 



Qi 



L L g(t — s)X(t)X(s) dtds in the continuous-time case 
J2k=i S 7 =i 9$ ~ J)X(k)X(j) in the discrete-time case, 



(1.13) 

where g(t) = J. e lXt g{X) dX, t £ U is the Fourier transform of some real, even, 
intcgrable function g(X), A £ A. We will refer g(X) as a generating function for 
the functional Qt- 

The limit distributions of the functionals (1-13) are completely determined 
by the spectral density /(A) and the generating function g(X), and depending on 
their properties the limit distributions can be either Gaussian (that is, Qt with 
an appropriate normalization obeys central limit theorem), or non-Gaussian. 
The following two questions arise naturally: 

a) Under what conditions on /(A) and g(X) will the limits be Gaussian? 

b) Describe the limit distributions, if they are non-Gaussian. 

These questions will be discussed in detail in Section 4.2. 

Let Ar(f) be the covariance matrix (or operator) of the process {X(u), u £ 
U}, that is, Ax{f) denote cither the T xT Toeplitz matrix, or the T-truncatcd 
Toeplitz operator generated by the spectral density /, and let Ar(g) denote 
either the TxT Toeplitz matrix, or the T-truncated Toeplitz operator generated 
by the function g. 

Our study of the asymptotic distribution of the quadratic functionals (1.13) 
is based on the following well-known results (see, e.g., [37, 42]): 

1. The quadratic functional Qt in (1.13) has the same distribution as the 

sum J2kLi ^fc^fe Efc=i ^fe£ic m the discrete-time case), where {£,k,k > 
1} are independent N (0, 1) Gaussian random variables and {A^,fc > 1} 
are the eigenvalues of the operator At(/)^4t(<?). (Observe that the sets 
of non-zero eigenvalues of the operators AT(f)Ax(g), Ax{g)AT{f) and 

1 /n 1/9 1 /9 

A T (f)AT{g)A T (/) coincide, where A T (/) denotes the positive definite 
square root of Ar(f)- 

2. The characteristic function ip(t) of Qt is given by 

oo 

<p(t) = l[\l-2itX k \- 1 / 2 , (1.14) 

fe=i 
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3. The fc-th order cumulant Xfc(') of Qt is given by 

oo 

Xk{Q T ) = 2 h -\k - 1)\J2^ = 2* _1 (* - ^ [AT{f)A T {g)f (1.15) 

.7=1 

Thus, to describe the asymptotic distributions of the quadratic functionals 
(1.13), we have to control the corresponding traces of the products of Tocplitz 
matriccs(or operators), yielding the trace approximation problem with generat- 
ing functions specified by (1.5). 



2. The Trace Problem for Toeplitz Matrices 

Let /(A) be an integrable real symmetric function defined onT= (— 7r,7r]. For 
T = 1, 2, . . . denote by Bt{J) the (T x T) Toeplitz matrix generated by function 
/, that is, 



BtU) ■■= ||/(*-t)L t= rr 



where 



/ /(o) /(-i) 
/(i) /(o) 

V f(T - 1) f(T - 2) 



/(I -T)\ 
7(2 - T) 



/(0) 



/ 



/(*)= / e 4At /(A)dA, tGZ, 

JT 

are the Fourier coefficients of /. 
Observe that 



ltr[B T (/)] = i.T/(0) 



/(A)dA. 



. (2-1) 



(2.2) 



(2.3) 



What happens when the matrix Bx{f) is replaced by a product of Toeplitz 
matrices? Observe that the product of Toeplitz matrices is not a Toeplitz matrix. 
The idea is to approximate the trace of the product of Tocplitz matrices 
by the trace of a Toeplitz matrix generated by the product of the generating 
functions. More precisely, let % = {hi, /12, ■ • ■ , h m } be a collection of integrable 
real symmetric functions defined on T. Define 



Sbm{T) := ^tr 



]B T {hi 



.i=\ 



M- 



T,H 



(27T) 



7T 


771 


-7T 


.»=i 



and let 

A(T) := A b ,t,w(T) = |5 b ,h(T) - M T , W 
Observe that by (2.3) 

1 



dA, (2.4) 



(2.5) 



a/t,« = (2TT)" 1 - 1 r 

J — TC 



JfH(X) 



d\ = — tr 
T 



Bt (Ylhi(X) 



\i=l 



(2.6) 
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How well is Sb,h(T) approximated by Mj^yl What is the rate of convergence 
to zero of approximation error Ab,t,h{T) as T — > oo? These are Problems (A) 

and (B). 

2.1. Problem (A) for Toeplitz Matrices 

Recall that Problem (A) involves finding conditions on the functions /ii(A), 
h 2 {\), . . ., h m (X) in (2.4) such that A B j,n( T ) = (!) as T ^ oo. 

In Theorem 2.1 and Remark 2.2 we summarize the results concerning Prob- 
lems (A) for Toeplitz matrices in the case where the exponents tu, k = 1, m (sec 
(1.2)) are all equal to 1 as in (2.4). 

Theorem 2.1. Let Ab,t,h(T) be as in (2.5). Each of the following conditions 
is sufficient for 

A BJM {T)=o(l) as T^oo. (2.7) 



(Al) hi e £ Pl (T), l<pi<oo,i = l,m, with 1/ Pl + ... + l/p m < 1. 
(A2) The function <p(u) given by 



/TV 
-7T 



hi(X)h 2 (X - ui)h 3 (\ - u 2 ) ■ ■ ■ h m {\ - u m -x) dX, (2i 



where u = (m,U2, ■ ■ ■ ,u m -i) £ R m \, belongs to L m 2 (T m x ) and is 
continuous at = (0, 0, . . . , 0). 

Remark 2.1. Assertion (Al) was proved by Avram [4]. For the special case 
Pi = oo, i = l,m, that is, when all hi are bounded functions, it was first 
established by Grenander and Szego ([37], Sec. 7.4). For m = 4; p\ = p 3 = 2; 
P2 = P4 = oo, (Al) was proved by Ibragimov [42] and Rosenblatt [54]. 

Assertion (A2), for m = 4, hi = ft.3 := / and h 2 = hi := g was proved in 
Ginovyan and Sahakyan [29]. 

Remark 2.2. For the special case m = 4, hi = /13 := / and h 2 = h& := g, 

in Giraitis and Surgailis [34] (see also Giraitis et al. [33]), and in Ginovyan and 

Sahakyan [29] , it was proved that the following conditions are also sufficient for 

(2.7): 

(A3) (Giraitis and Surgailis [34]). / e L 2 (T), g e i 2 (T), fg € L 2 (T) and 

/ 2 (A).g 2 (A-/i)dA^ ^ f 2 (X)g 2 (X)dX as ^0. 

J — TV 

(A4) (Ginovyan and Sahakyan [29]). The functions / and g satisfy 

f(X)<\X\~ a Li(X) and \g(X)\ < \X\~^L 2 (X) for Xe[-ir,ir], 

for some a < 1, (3 < I with a + f3 < 1/2, and L t G SV(R), X~ ia+ ^Li(X) G 
L 2 (T), i = 1,2, where 5y(R) is the class of slowly varying at zero functions 
u(X), X G M, namely linia^o "y./ = 1 for all a > 0, satisfying also w(A) € 
L°°(R), limA-fO it( A ) = 0, u(X) = u(-X) and < u(A) < u(/i) for < A < fi. 
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Remark 2.3. Case (A4), with a + j3 < 1/2, was first obtained by Fox and 
Taqqu [17]. 

Remark 2.4. It would be of interest to extend the results of (A3) and (A4) to 
arbitrary m > 4. 

We now consider the case when the product in (1.2) involves also inverse 
matrices, that is, r& = (— l) fe , k = 1, m. Wc assume that m — 2v, and the func- 
tions from the collection % = {hi, hi, ■ ■ ■ , h m } that involve Tocplitz matrices 
we denote by gi, i — l,i>, while those involving inverse Toeplitz matrices we 
denote by /$, i = 1, v. We set 



SIb,h(T) ■■= ^ 



HlBHfrT'BHg,) 



MI 



i,n •= 



2?r 



gj(A) 
l = \ /i(A) 



n 



dX, 



(2.9) 



(2.10) 



A7 B , T)K (T) := \SI B m{T) - MI %H \. (2.11) 

The following theorem was proved by Dahlhaus (see [15], Theorem 5.1). 

Theorem 2.2. Let ceN, and a,/?Gl with < a, (3 < 1 and z/(/3 - a) < 1/2. 
Suppose fi(X) and gi(X), i=l,v, are symmetric real valued functions satisfying 
the conditions: 

(CI) fi(X), i = l,u, are nonnegative and continuous at all X G T\{0}, ff (A) 
are continuous at all X G T, and fi(X) = O (|A|~ a ) as X — > for all 
S > and i = 1, v; 

(C2) d/{dX)fr 1 (X) and d 2 / '{dXf fr 1 (A) are continuous at all X £ T\ {0}, and 
for all S > and i = 1, v 

d k /(dX) k f- 1 (X) = O (\X\- a - k - 5 ) for k = 0, 1. 

(C3) 5i(A) are continuous at all X € T\ {0} and (?,:(A) = O (|A| _,3_ ) as X — > 
/or all S > and i = l,v. 



Then 



AI 



B.T.% 



(T) = o(l) as T 



2.2. Problem (B) for Toeplitz Matrices 

Recall that Problem (B) involves finding conditions on the functions /ii(A), 
n 2 (A), . . ., h m (X) in (2.4) such that A b ,tm(T) = 0(T~f) as T -> oo for some 
7>0. 

In Theorem 2.3 below we summarize the results concerning Problem (B) for 
Tocplitz matrices in the case where Tfe = 1, k = l,m. First we introduce some 
classes of functions (see, e.g., [13, 58, 60]). Recall that T = (— 7r,7r] and denote 



Fi(T) := If EL 1 (T) 



fc — — OO 



|A||/(*)| < oo; , 



(2.12) 
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where /(*) = / T e* xk /(A) dX, f(-k) = f(k), and 

T 2 A ^x^ n 



MV = Farma(T) :=U: /(A) = °— 



B(e iX ) 



(2.13) 



where < a 2 < oo, A(z) := ELo a ** fc (P e N ) and S ( z ) : = E*=o &*** (« G N ) 
are both bounded away from zero for \z\ < 1. 

Remark 2.5. The following implications were established in [58]: 

(a) If hJ 2 G Ji(T), then / x / 2 G Ji(T). 

(b) If / G T 2 (T), then / G J"i(T) and /- 1 G J" 2 (T). 

For ^ G L P (T), 1 < p < oo, let uj p (ip, 5) denote the L p -modulus of continuity 
of ip: 

U) p (il>,S):= sup \\ip(- + h) - il)(-)\\ p , S > 0. 

0<h<6 

Definition 2.1. Given numbers < 7 < 1 and 1 < p < 00, we denote by 
Lip(T;p, 7) the i p -Lipschitz class of functions defined on T (see, e.g., [13]): 

Lip(T;p, 7 )={V>(A)Gi7(T); Wp (^; S) = 0(<F), 5^0}. 

Observe that if ip G Lip(p, 7), then there exists a constant C such that 
WpfaM) < C6~< for all <5 > 0. 



Theorem 2.3. Assume that Tfc = 1, k = l,m, % = {/ii,/i2, • • • , /i m }> ond 'ei 
Ab,t,h(T) be as in (2.5). The following assertions hold: 



(Bl) 7//ii G J"i(T), z = l,m, then 

Ab,t,«(T)=0(T- 1 ) asT^oc. 



(B2) J/ the functions hi(X), i = l,m, have uniformly bounded derivatives on 
T := (— 7r, 7r], t/ien /or any e > 

ABx M (T)=0(r 1+E ) asT^oo. 

(B3) Assume that the function y(u) given by (2.8) with some constants C > 
and 7 G (0, 1] satisfies 

\<p(u) - p(0)| < C|U|T, U = ( Ul ,U2, . . . , u m _i) G I"- 1 , 

w/iere = (0,0, ... ,0) and |u| = |ui| + |u2| + • ■ ■ + |u m _i|. Then for any 
e > 

A b ,t,«(T) =0(T- 7+e ) as T^oo. (2.14) 

(B4) Leth t {X) G Lip(T; ft , 7 ) 7 p ?; > 1, * = 1,2, . . .,m, l/p x + • • • + l/p m < 1 

and 7 G (0, 1]. Then (2.14) holds for any e > 0. 
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(B5) Let hi(X), i — 1,2, ... ,m, be differentiable functions defined on T \ {0}, 
such that for some constants Cu > 0, Ci% > 0, and at, i = 1,2, ... ,m, 
satisfying < a» < 1, a := $2 i=1 a i < 1 

MX)\<C u \X\- ai , \h' t (X)\ < C 2l \X\-^ +1 \ AeT\{0}, l = T^. 

Then (2. 14) holds for any e > with 

7 = — (1-a). (2.15) 

to 

Remark 2.6. Assertion (Bl) was proved in Taniguchi [58] (see, also, [60]). 
Assertion (B2), which is weaker than (Bl), but under weaker conditions than 
those in (Bl), was proved in Lieberman and Phillips [48]. Assertions (B3)-(B5) 
for m = 4 were proved in Ginovyan and Sahakyan [32] . 

Remark 2.7. It is easy to see that under the conditions of (B2) we have 
hi <G Lip(T;p, 1) for any i = 1,2,. . .m and p > 1. Hence (B4) implies (B2). 

Example 2.1. Let h, t (X) = |A|~ tti , A e [— 7T,7r], i = 1,2,. ..m, with < a t < 1 
and a := Y^7=i a i < ^- ^ is easy to see that the conditions of (B5) are satisfied, 
and hence we have (2.14) with 7 as in (2.15). 

The next results (cf. Ginovyan [25]) show that for special case m = 2 the 
rates in Theorem 2.3 (B4) and (B5) can be substantially improved. 

Theorem 2.4. Let hi(X) G Lip(T;pi,7i) with Pi > 1, 1/px + I/P2 = 1 and 
7i € (0, 1], i = 1, 2, and let 



A 2 ,b(T) := 



^tr[- B T(/ii)B T (ft 2 )] - 2tt / MA)MA) dA 



T/ie 



0(T-(ti+72)) ] j/ 7l + 72 < 1 

A 2)B (T)= <( OCT^lnT), i/ 71 + 72 = 1 

OCT" 1 ), if 7i+72>l. 

Theorem 2.5. Assume that the functions hi(X), i = 1,2, satisfy the conditions 
of Theorem 2.3 (B5) with to = 2. Then 

A 2 ,b{T) = O (T- 1+{ai+a2 A as T->oo. (2.16) 



The next result, due to Taniguchi [58] (see, also, [60]), concerns the case when 
the product in (1.2) involves also inverse matrices, that is, Tk = (— l) fc , k = 1, to. 

Theorem 2.6. Let SI B .u(T), MIr,n and AI b ,tm(T) be as in (2.9), and let 
.Fi(T) and ^(T) be as in (2.12) and (2.13), respectively. If fi £ Ti and gi € 
.Fi(T), i = l,v, then 

AI BJM {T) = OiT- 1 ) as T -> oo. (2.17) 
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3. The Trace Problem for Toeplitz Operators 

In this section we consider Problems (A) and (B) for Toeplitz operators, that is, 
in the case where the generating functions are defined on the real line. Again, 
Problem (A) involves o(l) approximation and Problem (B) involves OiT -1 ) 
approximation with 7 > 0. The theorems in this section are proved in Section 
5. 

Let /(A) be an integrable real symmetric function defined on R. The analogue 
of the Fourier coefficients f(k) in (2.2) is the Fourier transform f(t) of /(A): 



/(*) 



e lXt /(A) dX, t e 



(3.1) 



The / in (3.1) will play the role of kernel in an integral operator. 

Given T > and an integrable real symmetric function /(A) defined on K, the 
T -truncated Toeplitz operator generated by /(A), denoted by Wr{f), is defined 
by the following equation (see, e.g., [30, 37, 42]): 

[W T (f)u]{t)= f f(t-s)u(s)ds, u( S )€L 2 [0,T], (3.2) 



where / is as in (3.1). 

It follows from (3.1), (3.2) and the formula for traces of integral operators 
(see, e.g., [35], p. 114) that 

pT p+oo 

tr [W T {f)\ = / f{t - t)dt = T/(0) = T / f(\)d\. (3.3) 

JO J -co 

We pose the same question as in the case of Toeplitz matrices: what happens 
when the single operator Wt{/) is replaced by a product of such operators? 
Observe that the product of Toeplitz operators again is not a Toeplitz operator. 
The approach is similar to that of Toeplitz matrices - to approximate the trace 
of the product of Toeplitz operators by the trace of a Toeplitz operator generated 
by the product of generating functions. More precisely, let % = {hi, h%, ■ • ■ , h m } 
be a collection of integrable real symmetric functions defined on ML Define 



Swm{T) := -tr 
and let 



\W T {hi) 



Mm 



H 



(2nY 



Jhi(X) 



A(T) := A WtRM (T) = \S W , H (T) - M R ,„|. 



dX, (3.4) 



(3.5) 



Observe that by (3.3), 

(2 7 r) m - 1 



fli 



Jhi(X) 



.1=1 



dX = -tr 



Wt (Y[hi(X) 



\i=l 



(3.6) 



How well is Sw,n(T) approximated by Mr^? What is the rate of convergence 
to zero of approximation error A^i^(r) as T — > oo? These are Problems (A) 
and (B) in this case. 



imsart-ps ver. 2011/11/15 file: GST-ps.tex date: April 25, 2013 



M. Ginovyan et al./The Trace Problem and its Impact in Probability 15 

3.1. Problem (A) for Toeplitz Operators 

In Theorem 3.1 and Remark 3.1 we summarize the results concerning Problems 
(A) for Toeplitz operators in the case where Tfc = 1, k = l,m. 

Theorem 3.1. Let A(T) := Aw,r,h(T) be as in (3.5). Each of the following 
conditions is sufficient for 

A(T)=o(l) as T^oo. (3.7) 

(Al) hi e L 1 (R) n LP'(R) ; pi>l,i= \~ra~, with 1/ Pl + ... + l/p m < 1. 
(A2) The function 93(11) defined by 

/+00 
h 1 (X)h 2 (X - wi)/i 3 (A - w 2 ) • • • h m (X - u m -i) d\, (3.8) 
-00 

where u = (ui,U2, ■ ■ ■ ,u m -i) G R m_1 , belongs to L m_2 (R m_1 ) and is 
continuous at = (0, 0, . . . , 0) € R 1 ™" 1 . 

Remark 3.1. For the special case m = 4, hi = /13 := / and hi = /14 := 
<7, Ginovyan and Sahakyan [30] prove that the following conditions are also 
sufficient for (3.7): 
(A3) / e L\R) n £ 2 (R), .9 € L^R) n L 2 (K), /.g £ L 2 (R) and 

f 2 (X)g 2 (X-fi)dX^ f(X)g 2 (X)dX as M -j. 0. 

> »/ — 00 

(A4) The functions / and 5 are intcgrable on R, bounded on R \ (— n, n), and 
satisfy 

f(X)<\X\~ a L 1 (X) and \g(X)\ < |A|^£ 2 (A) for Ae[-7T,7r], 

for some a < 1, (3 < 1 with a + (3 < 1/2, and L. t e SV(R), A-( a+,3) i,(A) € 
L 2 (T), i = 1,2, where Sy(R) is the class of slowly varying at zero functions 
u(X), X e R, satisfying u(X) e L°°(R), lim A ^ u(X) = 0, u(X) = u(-X) and 
< u(X) < u(p) for < A < ix. 

Remark 3.2. It would be of interest to extend the results of (A3) and (A4) to 
arbitrary m > 4. 

3.2. Problem (B) for Toeplitz Operators 

In Theorem 3.2 below we summarize the results concerning Problems (B) for 
Toeplitz operators in the case where Tfc = 1, k = l,m. Let 

Ti(R):=lfeL 1 (R): J \t\\f(t)\dt < 00 J , (3.9) 

where /(*) = / R e iXt /(A) dX, f(-t) = f(t). 
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For ip € L P (R), 1 < p < oo let oj p (4>, o") denote the L p -modulus of continuity 
of tp: 

lu p {i/j 7 6) := sup \\ip(- + h) - il)(-)\\ p , <5 > 0. 

0<h<8 

Given numbers < 7 < 1 and 1 < p < 00, we denote by Lip(R;p,7) the 
L p -Lipschitz class of functions defined on R (see, e.g., [13]): 

Lip(R;p,7) = {i/>(A)ei7(IR) : oj p (tf;; 5) = O(cF) as S -> 0}. 

Theorem 3.2 is the continuous version of Theorem 2.3. 

Theorem 3.2. Let % = {hi, h,2, ■ ■ ■ ,h m }, and Awm.h(T) and tp(u) be as in 
(3.5) and (3.8), respectively. The following assertions hold: 



(Bl) If hi S J"i(R), i = l,m, then 

&WmM T ) = 0(T- X ) as T^oo. (3.10) 

(B2) Assume that tp(u) G L 00 (M.'" 1 ^ 1 ) and with some constants C > and 
7^(0,1] 

\(p(u)-ip(o)\<c\u\\ u = (« 1 ,« 2) ...,« m . 1 )er- 1 , (3.11) 

where = (0,0, ... ,0) and |u| = |ui| + |u2| + • ■ ■ + |u m _i|. Then for any 
e > 

A w .r,«(T) = O (T^ 7+E ) as T^oo. (3.12) 

(B3) Let /ij(A) e Lip(R;pi,7), i = 1,2,..., to, 1/pi + ••• + l/p m < 1 and 

7 e (0, 1]. TTiera (3.12) holds for any e > 0. 
(B4) Lei hi(X), i — 1, 2, . . . , to, be differentiate functions defined on R \ {0}, 

smcA iftai /or some constants C\ > and cr, > 0, 5, > 1, i = 1, 2, . . . , to 

wii/i a := 2™. t o~i < 1 

(3.13) 
/or aH i = 1, 2, . . . ,m. Then for any e > 

A ff ,i, H (T) = 0(r''+ E ) as T^oo (3.14) 

with 

7=1(1-ct). (3.15) 

m 

The next results (see [25]), which are continuous versions of Theorems 2.4 
and 2.5, respectively, show that for the special case m = 2, the rates in Theorem 
3.2 (B3) and (B4) can be substantially improved. 
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Theorem 3.3. Let hi(X) £ Lip(R;£>j,7j) with pi > 1, l/pi + l/p2 = 1 and 

7i £ (0, 1], i = 1,2, and let 



&2,w(T) := 



^[Wt^Wt^)] - 2tt / /ii(A)/i 2 (A) 



dA 



T/ien 



( T -(7l+72)) ; ^ 7l + 72 <1 

A 2jW (T) = ^ O^ 1 lnT), if 71+72 = 1 
O(T^), if 7i+72>l- 

Theorem 3.4. Assume that the functions hi(X), i = 1,2, satisfy the conditions 
of Theorem 3.2 (B4) with m = 2. TTien 



A2,wCT) = 0(V- 1+ (' Tl + CT2 >) as T^oc 



(3.16) 



Remark 3.3. It would be of interest to prove the continuous analogs of Dahl- 
haus theorem (Theorem 2.2) and Taniguchi theorem (Theorem 2.6) for Toeplitz 
operators. 

4. Applications to Stationary Processes 

In this section we provide some applications of the trace problem to discrctc- 
and continuous-time stationary processes: ARFIMA and Fractional Ricsz-Bcsscl 
motions; central and non-central limit theorems, Bcrry-Essccn bounds, and large 
deviations for Toeplitz quadratic forms and functionals. 

4-1- Applications to ARFIMA time series and fractional 
Riesz-Bessel motions 

In this subsection we apply the results of Sections 2 and 3 to the important spe- 
cial cases where the generating functions are spectral densities of a discrete-time 
ARFIMA(0, d, 0) stationary processes or continuous-time stationary fractional 
Riesz-Bessel motions. 

We use the following notation: m = 2v\ 



h 1 (X) = h 3 (X) 
fc a (A) = h 4 (X) 



h*,-i(X) ■= /i(A) 
MA) := / 2 (A); 



and 



S V , A (T) = -trL4 T (A)A T (/ 2 )]", 



A„,a(T) := 



S v ,a(T) ~ (2tt) 5 



[/i(A)/ 2 (A)]«'dA 



(4.1) 
(4.2) 



where either A T (f t ) = Br(/i) and A = T or A T (fi) = W T (fi) and A = 
i = l,2. 
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4-.1.1- Applications to ARFIMA time series 

The next theorem gives an error bound for A2 i b(T) in the case where the corre- 
sponding Tocplitz matrices are generated by spectral densities of two discrete- 
time ARFIMA(0,d, 0) stationary processes. 

Theorem 4.1. Let fi(X), i = 1,2, be the spectral density functions of two 
ARFIMA(0,d,0) stationary processes defined as 



MA) = g-|l-e^r Mi 



1,2 



(4.3) 



with < of < oo and < d t < 1/2. Then under d:= di + d 2 < l/(2i/) 3 v e N, 
for any e > 0, 

A„,b(T) = 0(T-t+ £ ) as T^oo (4.4) 



with 



1 

27 



(di + da). 



(4.5) 



Proof. Assuming that A e (0, ir] (the case A g [— 7r,0) is treated similarly), and 



taking into account |1 



aiM 



2sin(A/2), we have for i = 1,2 



/i(A) = ^-2 

Z7T 



-2d; 



. A 

sin — 

2 



-i -2d; 



/,'(A) = tn 



-2di2~ 2d '- ] m- 



-2di-l 



A 
COS — 

2 



(4.6) 



It is clear that the conditions of Theorem 2.3 (B5) are satisfied with a- h = 2di 
and C\i = 6*2; = of, i = 1, 2, and the result follows. □ 

The next theorem, which was proved in Lieberman and Phillips [48], gives 
an explicit second-order asymptotic expansion for S , i,s(T) in the case where 
the Toeplitz matrices are generated by the spectral densities given by (4.3), and 
shows that in this special case a second-order asymptotic expansion successfully 
removes the singularity and delivers a substantially improved approximation. 

Theorem 4.2. Let fi(X), i = 1,2, be the spectral density functions of two 
ARFIMA(0,d,0) stationary processes defined by (4-3) with < of < oo and 
< d t < 1/2, i = 1,2. Then under d : = d\ + d 2 < 1/2 



S!,b(T): = 

as T — >• oo, where 

C(d 1 ,d 2 ) 



1 
T 

2- 



M#t(/i)Bt(/2)] 



A(A)/ 2 (A)dA- 



2^-2^2 



C(dl,d 2 ) 
J>l-2d 



T 



l-2d 



2o-(o-2TT 



cos(Trdi) cos(7rd 2 )r(2di)r(2d 2 ) 2d(l - 2d) ' 



(4.7) 



(4.8) 
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Remark 4.1. The asymptotic relation (4.7) in Lieberman and Phillips [48] was 
established by direct calculations using the explicit forms of functions ft given 
by (4.3). On the other hand, as it follows from (4.6), the functions fi (i = 1,2) 
satisfy conditions of Theorem 2.5 with a; = 2di (i = 1, 2), and hence (4.7) is a 
special case of Theorem 2.5. 

4-1-2. Applications to fractional Riesz-Bessel motions 

Now we assume that the underlying model is a continuous-time stationary pro- 
cess specified by a fractional Ricsz-Bcsscl motion. The following result is an 
immediate consequence of Theorem 3.1 (Al). 

Theorem 4.3. Let /i(A) = /(A) be the spectral density of a fractional Riesz- 
Bessel motion defined by (1.12), and let /2(A) = .9(A) be an integrable real 
symmetric function on K. If for some p, q > 1 with l/p+ l/q < 1/v (v £ N) we 
have g(X) e Li(M) and < a < l/(2p), a + j3 > 1/2, then 

Av,w(T) = o(l) as T^oo. 

Theorem 4.4. Let /i(A) = /(A) be as in (1.12) with < a < l/(2p) and 

a + f3 > 1/2, and let /2(A) = g(X) be an integrable real symmetric function from 
the class Lip(q, 1/p — 2a) with \/p + l/q < \jv, i/£ff. Then for any e > 

A„, W (T) = O (T-~> +e ) as T^oo. (4.9) 

with 7 = 1/p — 2a. 

Proof. The result follows from Theorem 3.2 (B3) and the following lemma, 
which is proved in the Appendix. 

Lemma 4.1. Let p > 1, < a < 1/p and let /(A) be differ entiable function 
defined on M. \ {0}, such that for some constant C > 



C|A|— if |A|<1 fCW-"- 1 if |A|<1 

C\X\- 5 if \X\>1 , - \ CIAI- 5 - 1 if |A|>1 



Then f € Lip(p, 1/p — a). 

Now to prove (4.9) observe that by (1.12), 

2a + 2(q + /3)A2 
/( A )-- A 2 Q+ i (1 + A ym- I 4 ' 11 ) 

It follows from (1.12) and (4.11) that the functions / and /' satisfy conditions 
(4.10) with a = 2a and S = 2a + 2/3. Hence by Lemma 4.1, /(A) G Lip(p, 1/p - 
2a). Therefore the result follows from Theorem 3.2 (B3). □ 
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Theorem 4.5. Let fi(X), i = 1,2, be the spectral density functions of two 
fractional Riesz -Bessel motions defined as 

hW= | A |wf+ A 2)A ' 0<a,<l/2, o i + A>l/2, i=l,2. (4.12) 

// ai + a 2 < 1/(2^), i/iera f^.5j /10/ds /or any e > with 

7 = — - (ai + a 2 ). (4.13) 

2^ 

Proof. It follows from (1.12) and (4.11) that the functions f\ and / 2 satisfy 
conditions of Theorem 3.2 (B4) with <jj = 2a^ and J, = 2a,; + 2/?j, i = 1, 2, and 
the result follows. □ 

The next theorem, which is a continuous version of Theorem 4.2, contains an 
explicit second-order asymptotic expansion for Si t w(T) in the case where the 
Toeplitz operators are generated by the spectral densities given by (4.12), and 
shows that in this special case a second-order asymptotic expansion successfully 
removes the singularity and delivers a substantially improved approximation. 

Theorem 4.6. Let fi(X), i — 1,2, be as in (4-12). Then under a : = ct\ + a 2 < 

1/2 

Si,w(T): = ^tr[W T {fi)W T (f2)] 
as T — > oo, where 

c( ) = 2C 1 C 2 7T 2 1__ 

Ul 2J cos(7rai)cos(7ra 2 )r(2ai)r(2a 2 ) 2a(l - 2a) ' l ' ' 

The proof is based on the following lemma, which contains an asymptotic 
formula for the covariance function of a fRBm process. It is proved in the Ap- 
pendix. 

Lemma 4.2. Let /(A) be as in (1.12) with < a < 1/2 and f3 > 1/2, and let 
r(t) : = f(t) be the Fourier transform of /(A). Then 

^)-t 2 "- 1 - * C r - (l + o(l)) as t^oo. (4.16) 

cos(7ra)l (2a) 

Remark 4.2. Taking into account the reflection formula T(2a)r(l — 2a) = 
7r/ sin(27ra), the asymptotic relation (4.16) can be written in the following form 

r(t) =Ct 2a ' 1 sin(7ra)r(l- 2a) ■ (1 + o(l)) as t ->• oo. (4.17) 
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Proof of Theorem 4-6. By Lemma 5.2 1) and Parseval-Plancherel theorem we 
have 

S T ,i = J (l-f)ri(t)r 2 (t)dt = 2jrj /i(A)/ 2 (A)dA - h - h, (4.18) 

where 

h= I ri(t)ra(t)dt (4.19) 

J\t\>T 

and 

1 ' T 



h= Tj_ l*l r i(*) r a(*)*- ( 4 - 2 °) 

Hence, for a : = on + ot 2 < 1/2 from Lemma 4.2 and (4.19), we have as T — >• oo 



/i = / n(t)r 2 (t) dt = 2 n(t)r 2 (t)dt 

\t\>T Jt>T 

2CiC 2 7r 2 



cos(7rai) cos(7ra2)r(2ai)r(2a2) Jt>T 



t 2{a ' 1] (1 + o(l)) 



2ClC27r2 ■T 2 «- 1 (l + o(l))(4.21) 



cos(7rai) cos(7ra2)r(2ai)r(2a2) 1 — 2a 
For 72, from Lemma 4.2 and (4.20), we have as T — > oo and a : = ai + a 2 < 1/2 

r T o r T 



h = ^J |t|r 1 (t)r 2 (t)*=|/ t ri (t)r 2 (t)dt 



T 

2 /-T 

i 2 "" 1 di (1 + o(l)) 



2 CiC 2 7r 



T cos(7rai)cos(7ra 2 )r(2ai)L(2a 2 ) Jo 

■T 2Q - i (l + o(l)). (4.22) 



ZCi^Tr 2 1 ^ 2a _ ] 



cos(7rai)cos(7ra2)r(2ai)L(2a2) 2a 

From (4.18), (4.21) and (4.22) the result follows. Theorem 4.6 is proved. 

Remark 4.3. (a) As in Remark 4.1, the rate in (4.14) can be obtained from 
Theorem 3.4. 
(b) We analyze the behavior of the approximations as ai,a2 — > 1/4. First 
observe that the first-order asymptotic formula has a pole when a := 
a,\ + a2 = 1/2. In particular, denoting ft '-=01+132, and using the change 
of variable A 2 = u, we have 

i 

oo ,,-1/2-c 



, raW* 



2TTdC 2 / ——gdu. (4.23) 

Jo (i + «r 



Applying the formula (see, e.g., [16]) 

u" 1 - 1 , T(m)T(n) 
77- , m+n du = ) ' K ' m > 0, n > 0, 4.24 

o (1 + u) m+n 1 (to + n) 
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with m = 1/2 — a and n = j3 — m = a + f3 — 1/2, from (4.23) wc find 

wa jT mm .a - 2 JClCa r W2 - <w. + o - V2) (4 25) 

Then, using the Laurent expansion of the gamma function T(l/2 — a) 
around the pole a = 1/2, from (4.25) we obtain: asa = ai+a2-> 1/2 

27r/ /i(A)/ 2 (A)dA = — -4-2 + 0(1). (4.26) 



— oo 



l-2a 



However, the asymptotic behavior of the second-order term C[a\ , a 2 ) (see 
(4.15)), as «i, «2 -+ 1/4 is readily seen to be 



C(ai 1 a 2 ) 



2tt 2 C 1 C 2 1 



cos(?rai) cos(7ra 2 )r(2ai)r(2a 2 ) 2a(l - 2a) 
2tt 2 C 1 C 2 1 



cos 2 (7r/4)[r(l/2)] 2 l-2a 
47rCiC 2 



O(l) 



l-2a 



O(l). (4.27) 



Thus, the pole in the first-order approximation is removed by the second- 
order approximation, so that the approximation 

2n[ + ~ fl (\)M\)d\- ^"^ (4.28) 

is bounded as ai,a 2 — > 1/4. 

This good behavior explains why the second-order approximation pro- 
duces a good approximation that does uniformly well over «i, a 2 £ [0, 1/4], 
including the limits of the domain, 
(c) The second-order equivalence holds along an arbitrary ray for which a = 
Qi + q 2 — >• 1/2. Indeed, let a\ £ [0, 1/2] be any fixed number such that 
cii — > a\ and a = «x + a 2 —* 1/2, then the representation (4.26) for the 
first-order asymptotic term continues to apply. 

On the other hand, using the reflection formula T(z)T(l — z) = -k / sin(7rz) 
with z = 2a°, we have from (4.15) as ol\ —> a? and a = oc\ + a 2 — > 1/2 

rl a 2i 2 dC 2 1 

C(ai,a 2 ) = 



cos(aiTr) cos(a 2 7r)r(2ai)r(2a 2 ) 2a(l - 2a) 

27T 2 C*lC 2 1 



cos(a?7r) cos[(l - 2a°>/2]r(2a?)r(l - 2a°) 1 - 2a 
27r 2 CiC 2 sin(2a?7r) 1 



0(1) 



0(1) 



cos(aj l 7r) sin(ai7r) 7r 1 — 2a 

f2§ + o (1) , 
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and again the second-order equivalence holds. 

Thus, in this special case, the second-order asymptotic expansion removes 
the singularity in the first-order approximation, and provides a substan- 
tially improved approximation to the original functional. 

4-2. Limit Theorems for Toeplitz Quadratic Functionals 

In this section we examine the limit behavior of quadratic forms and function- 
als of discrete- and continuous-time stationary Gaussian processes with possi- 
bly long-range dependence. The matrix and the operator that characterize the 
quadratic form and functional are Toeplitz. 

Let {X(u), a 6 11} be a centered real- valued Gaussian stationary process 
with spectral density /(A), A 6 A and covariancc function r(t) := f(t), t € 
U, where U and A are as in Section 1.2. We arc interested in the asymptotic 
distribution (as T — > oo) of the following Toeplitz type quadratic functionals of 
the process X(u): 

L L g(t — s)X{t)X(s) dtds in the continuous-time case 



where 



)o Jo 

Sfc=i Sj=i 9$ ~ J)X{k)X(j) in the discrete-time case, 



(4.29) 



g(t)= / e lAt g(X)dX, ieU (4.30) 

J A 

is the Fourier transform of some real, even, integrablc function g(X), A G A. We 
will refer g(X) as a generating function for the functional Qt- In the discrete-time 
case the functions /(A) and <?(A) are assumed to be 27r-periodic and periodically 
extended to R. 

The limit distributions of the functionals (4.29) are completely determined 
by the spectral density /(A) and the generating function g(X), and depending on 
their properties the limit distributions can be either Gaussian (i.e., Qt with an 
appropriate normalization obeys central limit theorem), or non-Gaussian. The 
following two questions arise naturally: 

a) Under what conditions on /(A) and g(X) will the limits be Gaussian? 

b) Describe the limit distributions, if they are non-Gaussian. 

4-2.1. Central limit theorems for Toeplitz quadratic functionals 

We first discuss the question a), that is, finding conditions on the spectral density 
/(A) and the generating function g(X) under which the functional Qt, defined 
by (4.29), obeys central limit theorem. 

This question goes back to the classical monograph by Grenander and Szego [37] , 
where the problem was considered for discrete time processes, as an application 
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of the authors' theory of the asymptotic behavior of the trace of products of 
truncated Toeplitz matrices. 

Later the problem a) was studied by Ibragimov [42] and Rosenblatt [54], in 
connection with the statistical estimation of the spectral (F (A)) and covariance 
(r(t)) functions, respectively. Since 1986, there has been a renewed interest in 
both questions a) and b), related to the statistical inferences for long-memory 
processes (see, e.g., Avram [4], Fox and Taqqu [17], Giraitis and Surgailis [34], 
Giraitis ct al. [33], Terrin and Taqqu [66], Taniguchi [59], Taniguchi and Kak- 
izawa [60], Ginovyan and Sahakyan [29], and references therein). In particular, 
Avram [4], Fox and Taqqu [17], Giraitis and Surgailis [34], Ginovyan and Sa- 
hakyan [29] have obtained sufficient conditions for the quadratic form Qt to 
obey the central limit theorem (CLT), when the model X(t) is a discrete-time 
process. 

For continuous time processes the question a) was studied in Ibragimov [42], 
Ginovyan [22, 24], and Ginovyan and Sahakyan [30]. 

Let Qt be as in (4.29). We will use the following notation: By Qt we denote 
the standard normalized quadratic functional: 

Qt = -J= (Qt - EQ T ) . (4.31) 

VI 



The notation 

Qt C==^> N(0, a 1 ) as T ->• oo (4.32) 

will mean that the distribution of the random variable Qt tends (as T — > oo) 
to the centered normal distribution with variance a 2 . 

Our study of the asymptotic distribution of the quadratic functionals (4.29) 
is based on the following representation of the fc-th order cumulant \k (■) of Qt, 
which follows from (1.15) (see, also, [37, 42]): 

0, for k = 1 

Xk(Qr) = { ui t i (4.33) 

T- h ^2 h - r (h - l)!tr [A T (f)A T (g)] k , for k > 2, 

where At(J) and AT(g) denote either the T-truncated Toeplitz operators (for 
continuous-time case), or the T x T Toeplitz matrices (for discrete-time case) 
generated by the functions / and g respectively, and trL4] stands for the trace 
of an operator A. 

The next result contains sufficient conditions in terms of /(A) and g(X) en- 
suring central limit theorems for standard normalized quadratic functionals Qt 
both for discrete- and continuous-time processes. 

Below we assume that f,g€ L 1 (A), and with no loss of generality, that g > 0. 
Also, we set 

.2 ie_3 / jr2/\\ 2 



^ = 16^ / f\\)g\\)d\. (4.34) 

JA 

As usual A = T= (— w, tt] or A = R = (—00, 00). The following theorem includes 
both discrete-time (A = (— ir, tt}) and continuous-time (A = (—00,00)). 
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Theorem 4.7. Each of the following conditions is sufficient for 

Q T <^> N(0,crl) as T^oo, (4.35) 

with o-Q given by (4-34) '• 

(A) f-geL 1 (A)DL 2 (A) and 

X2(Qt) := ^tr[B T (f)B T (g)] 2 — ► a 2 < oo. (4.36) 

(B) TTie function 

tp(u) := <p(ui,U2,ua) = / f{\)g(\-ui)f(\-u 2 )g{\-u 3 )d\ (4.37) 



belongs to L 2 (A 3 ) and is continuous at = (0,0,0). 

(C) / G L X (A) n LP(A) (p > 2) anrf 3 G L*(A) n L«(A) (g > 2) wrat/i 

l/p + l/ ff <l/2. 

(D) / G L^A) n L 2 (A), 5 G L^A) n L 2 (A), /<? G L 2 (A) and 

[ f 2 (X)g 2 (X-[i)dX^ [ f 2 (X)g 2 (X)dX as M ^0. 
J a J a 

(E) JTie spectral density /(A) and i/ie generating function g(X) satisfy 

f(X)<\X\- a L 1 (X), \g(X)\ < |A|-^L 2 (A), A G A, 

/or some a < 1, /3 < 1 u>«£/i 

a + /3 < 1/2 and L< G SV(R), A _(a+ ^Li(A) G L 2 (A), i = 1, 2, 

where SV(M.) is the class of slowly varying at zero functions u{X), X G R, 
satisfying u(X) G L°°(R), liiriA->ow(A) = 0, u(A) = it(— A) and < u(X) < 
u(j2) for < A < jj,. 

In the continuous-time case, we also assume that the functions /(A) and 
g(X) are bounded on R \ (— tt, 7t). 

Remark 4.4. For discrete-time case: assertions (A) and (D) were proved in 
Giraitis and Surgailis [34] (see also Giraitis et al. [33]); assertions (B) and (E) 
were proved in Ginovyan and Sahakyan [29]; assertion (E) with a + j3 < 1/2 
was first obtained by Fox and Taqqu [17]; assertion (C) for p = q = oo was first 
established by Grenander and Szego ([37], Sec. 11.7), while the casep = 2, q = oo 
was proved by Ibragimov [42] and Rosenblatt [54], in the general discrete-time 
case assertion (D) was proved by Avram [4]. 

For continuous-time case assertions (A) - (E) were proved in Ginovyan [24] 
and Ginovyan and Sahakyan [30]. 
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Remark 4.5. Assertion (A) implies assertions (B) - (E). Assertion (B) implies 
assertions (C) and (D). On the other hand, for functions /(A) = A~ 3 / 4 and 
g(X) = A 3 / 4 satisfying the conditions of (E), the function (p{ti,t 2 ,t 3 ) is not 
defined for t 2 = 0, t\ ^ 0, £3 7^ 0, showing that assertion (B) generally does not 
imply assertion (E) (see Ginovyan and Sahakyan [29]). 

Remark 4.6. Examples of spectral density /(A) and generating function g(X) 
satisfying the conditions of Theorem 4.7 (E) provide the functions 

/(A)HAr Q |ln|A|r and g(X) = \X\^\\n\X\\-\ (4.38) 

where a < 1, /3 < 1, a + (3 < 1/2 and 7 > 1/2 (sec Ginovyan and Sahakyan 
[29]). 

Remark 4.7. The functions /(A) and g(X) in Theorem 4.7 (E) have singularities 
at the point A = 0, and arc bounded in any neighborhood of this point. It can 
be shown that the choice of the point A = is not essential, and instead it can 
be taken to be any point Ao £ [— tt, it]. Using the properties of the products of 
Toeplitz matrices and operators it can be shown that Theorem 4.7 (E) remains 
valid when /(A) and g(X) have singularities of the form (4.38) at the same finite 
number of points of the segment [— 7r,7r] (see Ginovyan and Sahakyan [29]). 

Remark 4.8. The next proposition shows that the condition of positiveness and 
finitencss of asymptotic variance of quadratic form Qt is not sufficient for Qt 
to obey CLT as it was conjectured in Giraitis and Surgailis [34], and Ginovyan 

[23]. 

Proposition 4.1. There exist a spectral density /(A) and a generating function 
g(X) such that 



0< / f z {X)g z (X)dX<oo (4.39) 



lim sup X2 (Qt) = lim sup -tr{B T {f)B T {g)f = 00, (4.40) 

that is, the condition (4-39) does not guarantee convergence in (4- 36). 

To construct functions /(A) and g(X) satisfying (4.39) and (4.40), for a fixed 
p > 2 we choose a number q > 1 to satisfy l/p + l/q > 1, and for such p and q 
we consider the functions /o(A) and go (A) defined by 

/o(A) = { ©) 1/P < if2— ;<A<2- ,s = 2m (441) 



if 2-' 5 - 1 < A < 2-'% s = 2m 



10, if2 sl <A<2, s = 2m, 

where m is a positive integer. For an arbitrary finite positive constant C we 
set <?±(A) = 30(A) ± C. Then the functions / = /o and g = <?+ or g = g_ 
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satisfy (4.39) and (4.40) (for details we refer to Ginovyan and Sahakyan [29]. 
Consequently, for these functions the standard normalized quadratic form Qt 
does not obey CLT, and it is of interest to describe the limiting non-Gaussian 
distribution of Qt in this special case. 

4-2.2. Non- central Limit Theorems 

The problem b) for discrete-time processes, that is, the description of the limit 
distributions of the quadratic form 

T T 

Q T :=^2Y,g{k-j)X{k)X{j), TeN (4.43) 

fc=U=l 

if it is non-Gaussian, goes back to the papers by Rosenblatt [53]- [55]. 

Later this problem was studied in a series of papers by Taqqu, and Terrin 
and Taqqu (see, e.g., in [61], [64], [65], [66], and references therein). Specifically, 
suppose that the spectral density /(A) and the generating function g(X) are 
regularly varying functions at the origin: 

f(\) = \X\- a L 1 (X) and g(X) = |A|^L 2 (A), a<l,/3<l, (4.44) 

where £i(A) and L2(A) are slowly varying functions at zero, which are bounded 
on bounded intervals. The conditions a < 1 and j3 < 1 ensure that the Fourier 
coefficients of / and g arc well defined. When a > the model {X(t),t £ Z} 
exhibits long memory. 

It is the sum a + f3 that determines the asymptotic behavior of the quadratic 
form Qt- If a + ft < 1/2, then by Theorem 4.7(E) the standard normalized 
quadratic form 

T~ 1/2 (Qt - EQ T ) 

converges in distribution to a Gaussian random variable. If a + /3 > 1/2, con- 
vergence to Gaussian fails. 

Consider the embedding of the discrete sequence {Qt, T £ N} into a conti- 
nuous-time process {Qr(*)> T £ N, t £ K} defined by 

[Tt] [Tt] 

Qt® := E E 9( k - j)X{k)X{j), (4.45) 

fc=U=l 

where [ ] stands for the greatest integer. Denote by Z(-) the complex-valued 
Gaussian random measure defined on the Borel er-algebra B(R), and satisfying 
EZ(B) = 0, E\Z(B)\ 2 = \B\, and Z(-B) = Z(B) for any B £ B(R). 

The next result, proved in Terrin and Taqqu [65], describes the non-Gaussian 
limit distribution of the suitable normalized process Qt(0- 
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Theorem 4.8. Let /(A) and g(X) be as in (4-44) with a < 1, /3 < 1 and slowly 
varying at zero and bounded on bounded intervals factors L\(X) and L2(A). Let 
the process Qr{t) be as in (4-45). Then for a + f3 > 1/2 

Qr(t) := Ta+PLi{l ) T)L2{l/T) (Qr(t) - E[Q T (t))) (4.46) 

converges (as T — > ooj weakly in D[0, 1] to 



Q(t) 

where 



f K t (x,y)dZ(x)dZ(y), (4.47) 

JR 2 



r p it{x+u) _ i p it(y-u) _ i 

K t (x,y) = \xy\-^ 2 / - r-lul^dt*, (4.48) 

J R i(x + u) i(y-u) 

The double prime in the integral (4-4^) indicates that the integration excludes 
the diagonals x = ±y. 

Remark 4.9. The limiting process in (4.47) is real-valued, non-Gaussian, and 
satisfies EQ(t) = and EQ 2 (t) = J R2 \K t (x,y)\ 2 dxdy. It is self-similar with 
parameter H = a + (3 € (1/2,2), that is, the processes {Q(at),t > 0} and 
{a H Q(t),t > 0} have the same finite dimensional distributions for all a > 0. 

Remark 4.10. In [53] (see also [55]) Rosenblatt showed that if a discrete-time 
centered Gaussian process X(t) has covariance function r(t) = (1 + £ 2 )«/ 2 -i/2 
with 1/2 < a < 1, then the random variable 



Q T :=T- Q ^[X 2 (fc)-l] 



fe=i 

has a non-Gaussian limiting distribution, and described this distribution in 
terms of characteristic functions. This is a special case of Theorem 4.8 with 
t = 1, 1/2 < a < 1 and /3 = 0. In [61] (see also [64]) Taqqu extended Rosen- 
blatt's result by showing that the stochastic process 

[Tt] 

Q T (t):=T-]T[X 2 (fc)-l] 
fe=i 

converges (as T — > oo) weakly to a process (called Rosenblatt process) which 
has the double Wiener-Ito integral representation 

Q(t):=C a [ elt * +V ~ 1 \x\- a ' 2 \y\- a 'HZ{x)dZ{y). (4.49) 

J R2 i(x + y) 

The distribution of the random variable Q{t) in (4.49) for t = 1 is described in 
Veillette and Taqqu [67]. 
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Remark 4.11. The slowly varying functions L\ and Li in (4.44) are of impor- 
tance because they provide a great flexibility in the choice of spectral density / 
and generating function g. Observe that in Theorem 4.8 the functions L\ and Li 
influence only the normalization (see (4.46)), but not the limit Q(t). Theorem 
4.7(E) shows that in the critical case a + /3 = 1/2 the limit distribution of the 
standard normalized quadratic form Qt is Gaussian and essentially depends on 
slowly varying factors L\ and Li. 

Note also that the critical case a + (3 = 1/2 was partially investigated by 
Terrin and Taqqu in [66]. Starting from the limiting random variable Q(l) = 
<3(1; a, (3), which exists only when a+(3 > 1/2, they showed the random variable 

(a + /3-l/2)Q(l;a,/3) 

converges in distribution to a Gaussian random variable as a + j3 approaches to 

1/2. 

Remark 4.12. For continuous-time processes the problem b) has not been 
investigated, and it would be of interest to describe the limiting non-Gaussian 
distribution of the quadratic functional Qt- 

4-3. Berry-Esseen Bounds and Large Deviations for Toeplitz 
Quadratic Functionals 

In this section, we briefly discuss Berry-Esseen bounds in CLT and large de- 
viations principle for quadratic functionals both for continuous- and discrete- 
time Gaussian stationary processes (for more about these topics we refer to 
[6, 12, 14, 19, 44, 49, 59], and reference therein). 

Berry-Esseen Bounds. Let Qt and Qt be as in (4.29) and (4.31), respectively. 



Denote Qt '■= Qt/ ' \J^^{Qt), and let Z be the standard normal random vari- 
able: Z ~ N(0, 1). The CLT for Q T (Theorem 4.7) tells us that Q T — > Z 
in distribution as T — > 00. The natural next step concerns the closeness be- 
tween the distribution of Qt and standard normal distribution, which means 
asking for the rate of convergence in the CLT. Results of this type are known 
as Berry-Esseen bounds (or asymptotics). 

In discrete-time case, for special quadratic functionals, Berry-Esseen bounds 
were established in Tanoguchi [59] , while for continuous-time case, Berry-Esseen- 
type bounds were obtained in Nourdin and Peccati [49]. The next theorem 
captures both cases. 



Theorem 4.9. Let Q T be as in (4-31), Qt ■= Qt / 'y ^Var(Q T ) , and <J>(z) = 
P(Z < z), where Z - N(0, 1). Assume that f(\) E L\A) n L V (A) (p > 1) and 
g(X) G L 1 (A) n L q (A) (q > 1). The following assertions hold. 

1. If l/p+ 1/q < 1/4, then there exists a constant C = C{f,g) > such that 
for all T > we have 

sup\P(Q T <z)-<]>(z)\<-^=. (4.50) 

zeR v 1 
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2. If 1/p + 1/g < 1/8 and J A / 3 (A)g 3 (A) dX ^ 0, then there exist a constant 
c = c(/, g) > and a number Tq = To(/, g) > such that T > Tq implies 

sup|P(Q T <z)-$(z)|>-5=. (4.51) 

zeM v 1 

More precisely, for any z £ M, we have as T — > oo 

V3 (/A/ 2 (A).9 2 (A)dA) 3/2 

(4.52) 

Remark 4.13. In the continuous-time case, Theorem 4.9 was proved in Nourdin 
and Peccati [49], by appealing to a general CLT of Section 4.2 (Theorem 4.7), 
and Stein's method. The proof, in the discrete-time case, is similar to that of 
the continuous-time case. 

Large Deviations. We now present sufficient conditions that ensure large de- 
viations principle (LDP) for Toeplitz type quadratic functionals of stationary 
Gaussian processes. For more about LDP we refer to Bryc and Dembo [12], 
Bercu et al. [6], Sato et al. [56], Taniguchi and Kakizawa [60], and references 
therein. 

First observe that large deviation theory can be viewed as an extension of the 
law of large numbers (LLN). The LLN states that certain probabilities converge 
to zero, while the large deviation theory focuses on the rate of convergence. 
Specifically, consider a sequence of random variables {£„, n > 1} converging 
in probability to a real constant m. Note that £„ could represent, for instance, 
the n-th partial sum of another sequence of random variables: £ n = — Y^u—-\ ?7fc, 
where the sequence {rjk} may be independent identically distributed, or depen- 
dent as in an observed stretch of a stochastic process. By the LLN, we have for 
e >0 

P{|£„ - m\ > e] -)• as n -> oo. (4.53) 

It is often the case that the convergence in (4.53) is exponentially fast, that is, 

JP{|£n - m\ > e} « R(-)cxp[—nI(e,m)] as n -^ oo, (4.54) 

where R(-) = R(s, to, n) is a slowly varying (relative to an exponential) function 
of n and I(e,m) is a positive quantity. Loosely, if (4.54) holds, we say that the 
sequence {£, n } satisfies a large deviations principle. One of the basic problems 
of the large deviation theory is to determine J(e, m) and R(s, to, n). To be more 
precise, we recall the definition of Large Deviation Principle (LDP) (see, for 
instance, [12, 60]). 

Definition 4.1. Let {£„, n £ Z} be a sequence of real-valued random variables 
defined on the probability space (f2, T, P). We say that {£„} satisfies a Large 
Deviation Principle (LDP) with speed a n — > and rate function 7 : ffi. — >• [0, oo], 
if 7(x) is lower semicontinuous, that is, if x n — > x then liminf„_ i . 00 I(x n ) > I{x), 
and 

liminf a„logP{^„ £ A} > - inf I(x) 
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for all open subsets Act, while 

limsupa„logP{£„ € B} < — inf I{x) 

for all closed subsets Bel. The function I(x) is called a good rate function 
if its level sets are compact, that is, the set {i£l: I(x) < b} is compact for 
each del. 

Now let Qt be the Toeplitz type quadratic functionals of a process X(u) 
defined by (4.29) with spectral density /(A) and generating function g(X). 

The next result states sufficient conditions in terms of /(A) and g(X) to 
ensure that the LDP for normalized quadratic functionals {-^Qt} holds both 
for discrete- and continuous-time processes. 

Theorem 4.10. Assume that f(X)g(X) <S L°°(A). Then the random variable 
{■^Qt} satisfies a LDP with the speed ax = y and a good rate function I(x): 

I(x) = sup {xy-V(f,g;y)}, 

-oo<y<l/(2C) 

where C = ess supf(A)\g(A)\ and for y < 1/(2C) 

V(f,g;y) = -±-Jlog(l-2yf(X)g(\))d\. 

Remark 4.14. In the special case of g(X) = 1, Theorem 4.10 was proved by 
Bryc and Dcmbo [12], for general case we refer to Bercu et al. [6]. 

5. Proof of Theorems 3.1 - 3.4 

We only prove the results concerning Toeplitz operators (Theorems 3.1 - 3.4). 
The proofs of the corresponding results for Toeplitz matrices are similar. First 
we state a number of technical lemmas, which are proved in the Appendix. 
The following result is known (see, e.g., [30], [33], p. 8). 

Lemma 5.1. Let Dt(u) be the Dirichlet kernel 

, N sin(TW2) , , 

Dt(u) = K ' > . 5.1 

u/2 

Then, for any S € (0,1) 

\D T (u)\<2T s \u\ s -\ ueR. (5.2) 

Denote 

G T (u):= f e iTu dt = e lTu/2 D T {u), «£l, (5.3) 

Jo 

$t(u) : = (2 ^)m-i r ' Dt ^ ' ' ' D T(u m -i)D T (ui +■■■ + U m _!),(5.4) 

*(u) : = ip(ui,ui +vq,...,ui-\ hUm-i), (5.5) 
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where u = (y,i, . . ■ , u m -i) G K™ -1 and the function <p(u), corresponding to the 
collection H = {hi, h 2 , ■ . ■ , h m }, is defined by (3.8). 

The next lemma follows from (3.4) and (5.3) - (5.5) (cf. [30], Lemma 1). 

Lemma 5.2. Let % = {hi, hi, ■ ■ ■ , h m } be a collection of integrable real symmet- 
ric functions on IR, h/~ be the Fourier transform of function hk (fc = 1, . . . , to), 
and let S(T) := Sw,u(T) be as in (3.4)- The following equalities hold. 

1) S(T) = — / .../ hi(ui - u 2 )h 2 {u 2 - u 3 ) . . .h m (u m - ui) 

1 Jo Jo 

2) S(T) = — hi(ui) . . . h m (u m )G T (ui - u 2 )G T {u 2 - u 3 ) ■ ■ ■ 

xGrium — ui)dui . . . du m . 

3) S{T) = (2 7 r) m - 1 / *(u)$ T (u)du. 

For m = 3, 4 . . . and S > we denote 
E s = {(ui, . . . , u m _i) e M'"" 1 : |ui| < S, i = 1, . . . ,m - 1}, E£ = M" 1 - 1 \ E a 
and 

771—2 

p 3 = 2, p(m) = (to > 3). 

777—3 

Lemma 5.3. The kernel < E>t(u), u G R m_1 , to > 3 possesses the following 
properties: 

a) sup / |$t(u)| du = Ci < oo; 

b) / $ T (u)du=l; 

c) lim / |$t(u)| du = for any 5 > 0; 

rf) /or any S > £/*iere exists a constant C$ > smc/j i/iai 

|$ T (u)r (m) du<C d - /or T>0, (5.6) 

The proof of the next lemma can be found in [33], p. 161. 

Lemma 5.4. Let < /3 < 1, < a < 1, and a + (3 > 1. TTien /or an?/ 

y G K, y ^ 0, 

1 C 

r d;z; = i..i^-1-fl-i . ( 5 - 7 ) 



where C is a constant depending on a and j3. 

Denote E — {(ui,u 2 , . . . ,u n ) G R™ : \iii\ < 1, i = 1,2,..., 77} and let 

£ c = M" \ E. 
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Lemma 5.5. Let < a < 1 and -2- < 8 < 2±a. Then 

— n-\-l ' n+1 



Si := / 1 ■ ; --7T dui ■ ■ ■ du n < oo, i = l, ...,n. (5.8) 

J B |ui •••u„(ui H Vu n )\P 

Lemma 5.6. Let -£*■ < 8 < 1. TTiera 

n+l " 

/ := / | ■ ■ r-j dui • • • du„ < oo. (5.9) 

J E c \ui ■ • • u n (ui H h u n )\P 

Proof of Theorem 3.1. We start with (A2). By Lemma 5.2, 3) and 5.3, b), wc 
have A(T) = (2 7 r) m - 1 |i?(T)|, where 



R{T)= I [*(u) - *(0)]$r(u)du. 



It follows from (5.5) that the function *(u) belongs to L m ~ 2 (R m ~ 1 ) and is 
continuous at = (0, . . . , 0) € R" 1-1 . Hence for any s > we can find S > to 
satisfy 

|*(u)-#(0)|<^-, ugEj, (5.10) 

where Ci is the constant from Lemma 5.3, a). Consider the decomposition \f = 
*i + * 2 such that 

||*i|| (m -2) < -4= and Halloo <oo, (5.11) 

where C$ is as in Lemma 5.3, d). 

Observe that ^^ H — jTsy = 1) where p(m) = ^E§ ■ Hence, applying Lemma 
5.3 and (5.10), (5.11) for sufficiently large T we obtain 

\R(T)\ < [ |*(u)-*(0)||$T(u)|du + C' m / |*i(u)||* r (u)|du 
+ / |tf 2 (u)-tt(0)||$ T (u)|du<-^- / |$ T (u)|du 

/ $?, (m) (u)du +C 2 / |$ T (u)|du<3e, 



+ *i 



(m-2) 



and the result follows. □ 

Proof of (Al). According to Theorem (A2) it is enough to prove that the func- 
tion 

/+oo 
hi(\)h 2 {\ - ui)h 3 (\ - u 2 ) ■ ■ ■ h m (X - Um-i) dX, (5.12) 

-oo 

where u = (ux, . . . , u m _i) <G K m_1 , belongs to L m_2 (R m_1 ) and is continuous 
at = (0, . . . , 0) e R m ~\ provided that 

m ^ 

h i eL 1 CM.)C]L Pi (R), l<pi<oo, i = l,...m, V — < 1. (5.13) 

— ' Pi 
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It follows from Holder inequality, (5.12) and (5.13) that 

in 

k(u)|<nil/*lli"(»)< 00 . ueR" 1 - 1 . 

i=l 

Hence, tp € L°°(W n - 1 ). On the other hand, the condition hi € L X (R) and (5.12) 
imply tp e L 1 !!"'- 1 ). Therefore tp € L™- 2 (R m - 1 ). 

To prove the continuity of tp(u) at the point we consider three cases. 

Case 1. pi < oo, i = 1, . . . ,m. 
For an arbitrary e > we can find 6 > satisfying (see (5.13)) 

||/i i (A-w)-/i J (A)|| L p l(R) <e, i = 2,...,m, if |u| < <5. (5.14) 

We fix u = (ui, . . . , u m -i) with |u| < (5 and denote 

hi(X) = hi(X- Ui-i) - hi(X), i = 2,...,m. 

Then in view of (5.12) we have 

„ m— 1 

tp(u) = / MA) 1 [ (hiW + hi(X)) dX - tp(0) + W. 

It follows from (5.14) that ||fti|| p< < e, i — 2,,..,m. Observe that each of the 
integrals comprising W contains at least one function hi and can be estimated 
as follows: 



h 1 (u)h 2 (X)h 3 (X)...h m - 1 (X)dX 



< 



||M|lpi||M|lp2||M|lp3 •■• \\h m \\ L p™ < Ce. 

m 

Case 2. p t < oo, i — 1, . . . , m, J2 ^- < 1 - 

i=m 

There exist finite numbers p\ < pi, i = 1, ...,m, such that X)i=i ^-lv'% ^ 1- 
Hence according to (5.13) we have hi € L Pi i = 1, . . . , m and tp is continuous at 
as in the case 1. 

rn 

Case 3. p t < oo, i = 1, . . . , m, J2 h = 1 - 

»=i 
First observe that at least one of the numbers pi is finite. Suppose, without loss 

of generality, that p\ < oo. For any e > we can find functions h[, h'{ such that 

hi = h[ + h'{, h\ G L°°(R), \\h'l\\ LP1 < e. (5.15) 

Therefore 

tp(n) = tp'(vi) + tp"(vi), 

where the functions tp' and tp" arc defined as tp in (5.12) with h\ replaced by h' t 
and h", respectively. It follows from (5.15) that tp' is continuous at (see Case 
2), while by Holder inequality |y>"(u)| < C ■ e. Hence, for sufficiently small |u| 

\tp{n) - tp{Q)\ < \tp'(u) tp'(0)\ + \tp"(u) tp"(0)\ <(C+ l)e, 
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:!5 



and the result follows. Theorem 3.1 is proved. 



□ 



Proof of Theorem 3.2. We start with (Bl). First observe that the condition 
hi £ T\ implies that 

fe, e L'(l) and \hi(t)\ < A, tel, i = l,2,...,m (5.16) 

for some constant A > 0. By Lemma 5.2 we have 

T ■ S(T) = ... hi(ui- u 2 )h 2 (u 2 - u 3 ) . . . h m (u m - u\)dui . . . du m . 



Jo Jo 
Making the change of variables 

Ml — 1*2 = h, U 2 - U 3 — t 2 , ■ ■ ■ ,U m -l - U m = tm-l, 

and observing that t\-\ h t m -i = u i —u m ,we get (below we use the notation: 

t m -i = {tii ■ ■ ■ ,t m -i) and dt m _i = dt\ ■ ■ ■ dt m -i), 



T ■ S(T) 



T /"U m — tl — ...— t m — 1 ( t U rn —t\ — ...~t m — °2 

Ju m -t 1 -...-t m - 1 -T Ju m -ti-...-t m - 2 -T 



u m —ti 

hi(ti) ■ ■ ■ h m -i(t m -i)h m (—ti 

U m -tl-T 
l-T 

h\(ti) ■ ■ ■ h m -x\t m -i)h m {—t\ — . . 



(5.17) 

tm-l) [T — l{t m -l)] dt m _i, 



l-T J-T 

where 

\l(t m -i)\ = \l(h, . . . ,t m -i)\ <2(|ti| + ... + |t m _i|). (5.18) 

On the other hand, by (3.4) and Parseval's equality we have 



M : = M MtH = (2?r) 



m— 1 



Jh(X) 



dX 



OO /"GO 



oo J — oo 



h\(t\) ■ ■ ■ h m -i(t m -i)h m (—ti 



(5.19) 

£?7i— 1 )^>m— 1 • 



It follows from (3.4), (5.17) and (5.19) that 

S(T) - M := S W , H (T) - M R , n 



T 



+ 



[-T,T] r > 



hi(ti) ■ ■ ■ h m -i(t m -i)h m (—ti — ... — t m -i)l(t m -.i)dt r 



-l\[-T,T}r 



h\{t\) ■ ■ ■ h m -l(tm-l)h m (—tl — ... — tm-l)dt m -i 



=: Aj. + Ay. 



(5.20) 



imsart-ps ver. 2011/11/15 file: GST-ps.tex date: April 25, 2013 



M. Ginovyan et al./The Trace Problem and its Impact in Probability 36 

By (5.16), (5.18) and (5.20) wc have 

771—1 p 

\T-A 1 T \<2AY, i \h 1 (ti)--'h m -i(t m -i)U\dt m -i-.A 1 <oo, (5.21) 

i— 1 

since hi G Ti, i = 1,2, . . . ,m. 
Further, observe that 

777 rn 

R m-1 \ [_ T) jtjm-1 c (J | (ti) _ _ ^ tm _ x) g R m-1 . | f .| > T} =: |J B 4 . 



Hence by (5.16) and (5.20) we have 



m— 1 p 

\T-A 2 T \<2AY] / |M*i). 



. /i m _i(t m _i)tJrft m _i =: A-2 < oo. (5.22) 



From (5.20) - (5.22) we get (Bl). □ 

Proof of (B2). By Lemma 5.2, 3) and Lemma 5.3, b), and (3.5) we have 



A(T) = (2tt)' 



[*(u) - *(0)]$ T (u)du 



, 0=(0,...,0). (5.23) 



It follows from (3.11) and (5.5) that for u = (ui, . . . , w m _i) € 



prn — 1 



|*(u)-*(0)| < (m-l)C(|wi| 7 



"2!/-! 



(5.24) 



Let £ G (0, 7). Then, applying Lemma 5.1 with S = 1+e 7 , and using (5.23) and 
(5.24), we can write 



A(T) < C m f |*(u) - *(0)||$ T (u)|du 
|*(u)-*(0)||$ T (u)|du 



-C 



,-, ro-1 



(5.25) 



J 1 ! — rn<5 



+2||vllc 



"J J_E |W1 ' ' ' Um-l(ui H h U m -l' 



jY^- din • • • dWm-l 



C /j 



r 1 m<5 7 E c |ui • • • w m _i(ui H h w m -i)| 



Y^-dui • • -dum-i, 



where E — {(ui,U2, ■ ■ ■ ,u m -i) € R m * : l w i| < L * = 1,2, ... ,m — 1} and 
E c = R m-i \ £|_ Since 

m — 1 „ m — 1 + 7 

< 1 -<5 < L , 

m m 

we can apply Lemmas 5.5 and 5.6 with a = 7, n = m — 1 and /3 = 1 — S to 
conclude that all the integrals in (5.25) are finite. Since 1 — m6 = 7 — 2, from 
(5.25) follows the statement (B2). □ 
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Proof of (B3) . According to (B2) it is enough to prove that the function 

ip(u) := / hi(X)h 2 (X- wi) ■■ -h m (X- u m -i)du, (5.26) 



where u = (m,--- ,u m -i) € R m 1 , belongs to L°°(W n - 1 ), and with some 
positive constant C 

\<p(u) - <p(0)\ < C|uP, ugK™" 1 , (5.27) 

provided that 

m 1 

hi eLip(R;pj,7), l<p 4 <oo, i = l,2,...,m, and V — < 1. (5.28) 

£?« " 

It follows from Holder inequality and (5.28) that 

in 
\f(n)\ < Y[\\hi\\ Pi <oo, ueR™" 1 . 

i=l 

Hence <£ € ^(K"'- 1 ). 

To prove (5.27) we fix u = [u\, . . . , u m _i) € R m_1 and denote 

hi(X) = hi{X-Ui-i)-hi{X), AeR, i = 2,,..,m. (5.29) 

Since /ij S Lip(R;pi,7) we have 

WhiWiH < Ci|u| 7 , » = 2,...,m. (5.30) 

By (5.26) and (5.29), 

¥>(u) = / fci(A) TT (fc(A) + hi(A)) dA = p(0) + W. 

Each of the (2 m — 1) integrals comprising W contains at least one function 
/j, and in view of (5.30), can be estimated as follows: 

h 1 {X)h 2 (X)h a {X)---h m (X)dX 



D 



< IIM Pl IIMUIM")IU'--|IMUn <C\U\\ 

This completes the proof of (B3). 
Proof of '(B4). We set 

1 1 . . 

— := <7j H 1 - (in H cr,„) , «' = 1, 2, . . . , m. 

Pi to 
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38 



Then 



™ 1 1 1 

E— = 1 and a t -\ [1 - (<r 1 -\ er m )] = 7 > 0, i — 1, 2, . . . , m, 
n ■ -n ■ rr? 



i=\ 

and 



< a, L < - < 1 < 5 t , i = 1,2, 



Hence, according to Lemma 4.1, hi G Lip(p 2 , 7), i = 1, 2, . . . , m. Applying (B3), 
we get (3.14) with 7 as in (3.15). □ 

Proof of Theorem 3.3. First observe that by Lemma 7 from [31] 

Sa.wCT) := itr[W r (fti)Wr(M = 2tt / f F T {s-t)h x {s)h 2 {t)dtds, (5.31) 
where Fx(u) is the Fejer kernel: 



, N 1 /sinTu/2\ 

Below we use the following properties of Ft(u) (see, e.g., [13]): 
/ F T (u)du= 1, 

F T (u)du<CT- 1 , 



U>1 

1 



CT~ a , if a < 1 

^ T (u)u"dii<^ CT-MnT, if a=l 

CT" 1 , if a > 1. 



Since the function Ft(u) is even, in view of (5.31) we can write 

S 2 ,w(T) = tt / / F T (u)[/ii(u + i)/i 2 (i) + M«)Mu + *)]dudt. 

JRJR 

Consequently, taking into account (5.32) and the equality 

/ h 1 (t)h 2 {t)dt = / h 1 (u + t)h 2 {u + t)dt, 
Jw Jn 

by (5.35) we get 



A 2 ,w(T): = 



T 



tr[W r (/ii)W r (/i2)] - 2tt / /n(i)/i 2 (t)dt 



(5.32) 
(5.33) 

(5.34) 



(5.35) 



(5.36) 



7T / F T (w) / (h 1 (t)-h 1 {u + t))(h 2 (u + t)-h 2 (t))dtdu 
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Using Holder's inequality, we find from (5.37) 

A 2 ,vy(T) <n f F T (u)\\hi(u + •) - &i(')IWM« + - h 2 {-)\\ q du. (5.37) 

JR 

In view of (5.37) we have 

A 2 ,w(T)<Ci / F T (u)\up 1+ ^du + C 2 \\h 1 \\ p \\h 2 \\ q [ F T {u)du. (5.38) 

JO Jti>l 

Therefore, the result follows from (5.33), (5.34) and (5.38). □ 

Proof of Theorem 3.4- It follows from Lemma 4.1 that under the assumptions 
of theorem hi € Lip (p*, 1/pi — ctj), i = 1,2. Hence, applying Theorem 3.3 with 
ji = l/pi — o~i, wc obtain (3.16). □ 

6. Appendix. Proof of Technical Lemmas 

In this section we give proofs of technical lemmas stated and used in Sections 4 
and 5. 

Proof of Lemma 4.1. Let h G (0, 1/2) be fixed. Then 

fZh 

\f(X + h)-f(X)\ p dX<(2C) p \X\- pa dX < dh 1 -^. (6.1) 

Jo 

\\\<2h 

Next, for |A| > 2h we have f(X + h) - /(A) = /'(£) • h with some £ G (A, A + /i). 
Hence 

/•1/2 

|/(A + ft) - f{X)\ p dX < C p h p / |A|- p(ff+1) rfA < Cft 1- * 7 (6.2) 

2h<\\\<l/2 

and 

|/(A + fr)-/(A)| p dA <C p h p [ \X\- p{a+1} dX 

A/2 

l/2<|A|<oo 

/OC 
| A |-p(5+l) dA 

< C7i p < CTi 1 "^. (6.3) 

From (6.1), (6.2) and (6.3) we get 

\\f{X + h)-f{X)\\ p <Ch l / p -\ 
implying / G Lip(p, 1/p - cr). D 
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Proof of Lemma 4-2. We use the technique of [45], where (4.16) was proved for 
/3 = 1. Since the underlying process X(t) is real- valued, we have for t > 

e itx f(\)d\ = 2J A2a(1 + A2)/9 cos(tA)dA. (6.4) 

Using the change of variable A = l/(tu), we obtain 

r(t) = «.^jf"( I ^)'^o-(l/.)*, 

/•GO 

= 2C-t 2Q_1 / L(tu)k(u)du, (6.5) 



./o 

where 

M 2/3 

£(u) = ■; kt^- and k(u) = u 2a 2 cos(l/u). 

V ' (1 + u 2 )^ K ' y ' ' 

Choose 5 > such that 5 < min(l — 2a, 2a). Then the improper integrals 

1 />oo — 

— <5;„/„,\ J„. „„J / „,<5 7 



m fc(u) du and / u k{u) du 
o+ J\ 

exist. Therefore, by the Bojanic-Karamata theorem (see [8], Th.4.1.5 ) we have 



k(u)L(tu)du — > / k(u) du as t — > oo. (6-6) 

o Jo+ 

Next, using the change of variable 1/u = v and the formula (see, e.g., [16]) 

x p cosimx) dx = - -. r^=r; , , < p < 1, m > 0, 

2cos(j>7r/2)r(p) 

with p = 2a and m = 1, we obtain 

/•OO — 

fc(u)du = / u 2a - 2 cos(l /u)du = ^ — -. (6.7) 



io+ Jo 2cos(7ra)r(2a) 

From (6.4)-(6.7) we get (4.16). □ 

Proof of Lemma 5.3. The proof of properties a) - c) can be found in [5], Lemma 
3.2 (see also [30], Lemma 2). To prove d) first observe that for T > 

/ \D T {u)\ p(m) du < C ■ TP^- 1 and \D T (u)\ < Cg for \u\ > S. (6.8) 

For u = (mi, . . . , u m -i) G R" 1 ^ 1 we have 

/ $ p T {m) (u)du < f $ p T {m \u)du + f <S> p T {rn) (u)du 
Jei J J 

|«i|><5 |u2|><5 

+ ...+ f ^ m) (u)du 

|u m _i|><5 

=: h+I 2 + ...+/„,_!. (6.9) 
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It is enough to estimate I\ (I 2 , ■ ■ ■ , I n can be estimated in the same way). We 
have 



f ^ m \u)du+...+ J $P (m) (u)du 

\u 2 \>S/m |«l|>( 

+ / ® p T {m) (u)du 



h < 

\ui\>5. \u2\>S/m \ui\>5, \u m -i\>8/ 



|u-i|>5, \u2\<5/m, |'u, m _i|<<5/m 

=: l[ 2) + . . . + l[' n - 1} + l{ m) . (6.10) 

According to (6.8) 

7 i 2) ^ C « ■ j^n) ■ J \D T {u 2 )\ p{m) ■ ■ ■ \D T {u m -x)\ p{m) 

\u 2 \>S/m 

x \D T (ui + . . . + u m -i)\ du\du m -\ ■ ■ -du 2 

< Cx ■ ■ T^t™)- 1 )'" 1 - 2 ) / duo < Cx (6 11) 

^ °<5 T p(m) 1 J \ U2 \p(m) aU2 ~ ° 5 - ^- LL ) 

\u 2 \>S/m 

Likewise, 

l[ j) <C s , j = 3,...,m-l. (6.12) 

Next, observe that in the integral l[ m , we have |ui + . . . + u m _i| > S/m,. Hence 
by (6.8) 

l[ m) < Cs ■ j^ J D# m \ui) ■ ■ ■ D^ m \u m - 1 )du 2 ■ • • dUm-xdUx 

|«i|><5 

- Cs I w¥^ dUl - Cs ' ( ° 3) 

|ui|><5 

From (6.9) - (6.13) we obtain (5.6). Lemma 5.3 is proved. 

Proof of Lemma 5.5. Using Lemma 5.4 and the notation du = du n du n -\ ■ ■ ■ dux, 
we can write 

Bl ~ J RF" J \U 2 ---U n - 1 \(> J \u n (u l + ---+U n )\P ^ 

{|«i|<l} K"- 2 H 

1 / L 

|«i|^- Q J \u 2 ---u n -x\ fi \(ux + ---+u n -x)\' 

{|«i|<l} R 71 - 2 

- C J rf 77 J \u2---u n ^nu 1 + ---+u n - 2 )\^ dUn - 2 '" dui 

{|«i|<l} R"- 3 
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< 

- ° n j RF^y \u 2 \p\{u 1+ u 2 )\i^)p-^ du2dui 

{|«i|<l} R 

< C n_1 / i — n xtva Tr du i < °°> 

— J \ Ul Un+l)P-a-n+l L ' 

{|«i|<l} 

yielding (5.8) for i = 1. The quantities B 2 , ■ ■ ■ , i? n can be estimated in the same 
way. 

Proof of Lemma 5. 6. We have 

I< / H h / 1 ■ ■ r^r dm ■ ■ ■ du n =: h -\ h In- 

J J \ui ■ ■ ■ u n {ui -\ Vu n )\p 

|«i|>i |m„|>i 

(6.14) 

Using Lemma 5.4 we get 

h ~ J RF J \v.2---Un-tf] \u n (u 1 + ---+U n )\P dUn '" dUl 

|«i|>l K™- 2 H 

- C / RF / K--- n -il^K + --- + ^-il 2 ^ ldu "- 1 '" dMl 

|ui|>l R™- 2 

< 

< C" -1 / r — ,, - 1V , — ZT d«i<oo. 

_ 7 |u 1 |(™+ 1 )'3-n + 1 

|«l|>l 

The quantities I 2 , ■ . ■ ,I n can be estimated in the same way, and by (6.14) the 
result follows. 
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